TITLE OF THE INVENTION 



USER INTERFACE DISPLAY APPARATUS AND METHOD OF 
CONTROLLING SAME 

BACKGROUND OF THE INVENTION 

This invention relates to a user interface display 
apparatus for operating, e.g., an image processing 
apparatus, and to a method of operating the image 
processing apparatus, for the purpose of enhancing 
operability. 

In an information processing apparatus such as a 
personal computer (referred to as a "PC" below) , an 
image processing apparatus such as a printer or 
facsimile machine connected to the PC and application 
software (referred to simply as an "application" below) 
for operating the image processing apparatus are used to 
display a user interface on the PC. The user interface 
on the PC is operated to utilize the functions of the 
image processing apparatus. In a typical example of 
such an arrangement, binary or text data that has been* 
stored in a storage device, e.g., a memory or a hard 
disk drive (HDD) within the PC c^n be transmitted by the 
connected facsimile machine using a facsimile 
application, and data that has been received by the 



facsimile machine can be displayed on a display device, 
which has been connected to the PC, using the facsimile 
application . 

Image data to be transmitted for facsimile purposes 
5 can also be entered from an image scanner or the like 
connected to the PC. In this case the procedure 
involves the user loading the document in the image 
scanner, launching the image reading application to read 
□ the image from the document, storing the read image data 

M 10 temporarily on a storage device within the PC (or in an 

3 external storage device accessible from the PC) and then 

y launching the facsimile application to transmit the 

image data . 

2 Similarly, in a case where a document copying 

T 15 operation is performed using an image scanner and a 

^ printer that are connected to a PC, the procedure 

followed involves the user launching a copying 
application to read the image of the document, input the 
image to the PC and then output the image from the PC to 
2 0 the printer, as described in the specification of 

Japanese Patent Application Laid-Open (KOKAI) No. 9- 
288554, by way of example. On the other hand, an 
embodiment in which the fact that a document has been 
placed in a scanner is sensed, in response to which the 
25 document is read, is described in the specification of 
Japanese Patent Application Laid-Open No. 9-93381. 
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However, in a case where the image processing 
apparatus connected to the PC in the examples of the 
prior art mentioned above is an apparatus capable of 
being used especially as a stand-alone device, i.e., in 
5 a case where the apparatus is a copier or facsimile 
machine, the control panel provided on the image 
processing apparatus so that it may be used in stand- 
alone fashion and the image which the PC displays on the 
display device when data is sent and received are 

10 completely different. 

For example, a command for implementing a function 
which is a button on the control panel of a facsimile 
machine is displayed only as characters on the display 
device of the PC. Even if the command is displayed 

15 graphically, the design and placement of the graphic 

display differ entirely from the button on the control 
panel. As a consequence, this approach does not allow 
one to intuit, in terms of appearance, the association 
between the display and the control panel of the actual 

20 facsimile machine. 

Thus, the control panel possessed by the image 
processing apparatus itself and the control-panel 
display presented on the PC connected to this image 
processing apparatus are visually quite different from 

25 each other and there is no clear association between the 
display and the actual apparatus. This leads to 



- 3 - 



inconveniences. For example, consider a case where the 
method of operation itsed when making a transmission 
differs depending upon whether the information medium is 
tangible (information on paper) or intangible 
(electronic information) , as when information that has 
been written on paper is transmitted by operating a 
facsimile machine or when electronic data, such as a 
word-processed document or an image created by a PC, is 
transmitted from the PC by operating the facsimile 
machine. In such case the operation performed at the 
actual apparatus (the facsimile machine) and the 
operation performed at the PC are different despite the 
fact that the same apparatus is operated. This not only 
makes it necessary to remember both methods of operation 
but also is a cause of erroneous operation. 

As another example, consider a case where a 
plurality of types of image processing apparatus having 
the same functions are capable of being utilized by a 
PC. In this case also the PC displays only the same 
operating screen, making it difficult for the operator 
to tell which image processing apparatus is being 
instructed to perform processing. For example, in a 
situation where both a color copier and a black-and- 
white copier are capable of being used, the operator 
selects the particular output destination depending upon 
the type of document that is to be output . With the 



prior art, however, the screen display presented by the 
PC does not differ that much, the display differing in 
terms of the model number of the image processing 
apparatus at best. This makes it easy for the operator 
5 to perform an erroneous operation, such as accidentally 
instructing that a color document be output to the 
black-and-white copier . 

Similarly, consider application software run by the 
PC to utilize a remote image processing apparatus. The 

10 screen display and the method of operation differ for 
each application, and even if the application is the 
same, version updates can require a change in the method 
of operation. As a result, the environment to which the 
operator has grown accustomed must be altered on each 

15 occasion. 

Further, in a case where an image that has been 
entered from an image input apparatus connected to the 
PC is to be transmitted for facsimile purposes or 
copied, the operation for reading the document must be 

2 0 performed after first launching not only the facsimile- 
transmission application and copying application but 
also the application that is for reading the image. If 
the PC has not been started up or has been placed in a 
power conserving mode, for example, the user must 

25 perform all of the above-mentioned operations, from 

activation of the PC to launching of the applications. 
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This is a more troublesome and time-consuming operation 
than what would be entailed by using the devices such as 
the facsimile machine and copier in stand-alone fashion. 



SUMMARY OF THE INVENTION 



Accordingly, an object of the present invention is 
to provide a remotely controllable apparatus and remote 
control method in which there is little disparity 
between a case where the apparatus is controlled using a 
control panel possessed by the apparatus itself and a 
case where the apparatus is controlled remotely from a 
PC or the like, thereby facilitating control of the 
apparatus . 

Another object of the present invention is to 
provide a method of remotely controlling a remotely 
controllable apparatus in which operability is enhanced 
when remotely controlling a data processing apparatus 
from a PC . 

A further object of the present invention is to 
enhance convenience when transmitting or outputting the 
image of a document utilizing an image input device and 
a remotely controllable apparatus connected to a PC. 



controllable apparatus which has a control panel for 




Specifically, according to one aspect of the 



there is provided a remotely 



specifying a processing operation and which is operated 
in accordance with an indication from the control panel 
and/or an externally supplied command, characterized in 
that the apparatus has storage means for storing 
control-panel data representing external appearance of 
at least principal portions of the control panel. 

According to another aspect of the present 
invention, there is provided a remote control method for 
controlling a remotely controllable apparatus from an 
external device connected to the remotely controllable 
apparatus, wherein the apparatus has a control panel for 
specifying a processing operation and which is operated 
in accordance with an indication from the control panel 
and/or an externally supplied command, the method 
comprising the steps of: displaying, on the external 
device, a virtual control panel having an appearance 
identical with or similar to at least part of the 
control panel; designating a desired position on the 
virtual control panel; generating a command of the 
remotely controllable apparatus corresponding to the 
position designated on the virtual control panel; and 
supplying the generated command to the remotely 
controllable apparatus . 

According to still another aspect of the present 
invention, there is provided a remote control system 
comprising: a remotely controllable apparatus which has 



a control panel for specifying a processing operation 
and which is operated in accordance with an indication 
from the control panel and/or an externally supplied 
command; an information processing apparatus capable of 
supplying a command to the remotely controllable 
apparatus; and a display unit and input device connected 
to the information processing apparatus, wherein the 
information processing apparatus includes: display 
means for displaying, on the display unit, a virtual 
control panel having an appearance identical with or 
similar to at least part of the control panel; 
discriminating means for associating a command, which 
operation of the control panel causes to be applied to 
the remotely controllable apparatus, and an operation 
performed on the virtual control panel; and 
communication means for supplying the remotely 
controllable apparatus with a command that corresponds 
to an operation performed on the virtual control panel. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 



BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a block diagram illustrating an 
embodiment of the present invention; 

Fig. 2 is a diagram showing an example of a 
connection using a host computer; 

Fig. 3 is a diagram showing an example of the 
structure of control-panel data; 

Fig. 4 is a diagram showing the structure of 
simplified control-panel data and an example of the 
data ; 

Fig. 5 is a diagram showing an example of the 
transfer format of control-panel data; 

Fig. 6 is a flowchart showing a registration 
operation of a computer; 

Fig. 7 is a diagram showing an example of a virtual 
control panel displayed on a display unit; 

Fig. 8 is a flowchart illustrating the operation of 
the computer when a document to be transmitted has been 
placed on a facsimile/copier; 

Fig. 9 is a flowchart illustrating editing of the 
virtual control panel performed by the computer; 

Fig. 10 illustrates an example of an editing screen 
for editing the virtual control panel; 

Fig. 11 is a flowchart illustrating an example of 
operation for generating a virtual control panel for 



each user; and 

Fig. 12 is a flowchart illustrating operation when 
a copier is remotely controlled using a virtual control 
panel that has been edited by the user. 



\\3P7 The present invention will now be described in 
detail With reference to the drawings. Though the 
followirig embodiment is described in regard to an 
example dVi which a copier (referred to as a "fax/copier" 
below) having a facsimile function is used as an 
apparatus t© be controlled by the user, the present 
invention isYapplicable other types of image processing 
apparatus as well. 
( Embodiment ) 

Fig. 1 is a block diagram illustrating an 
embodiment of the present invention. The embodiment 
includes a computer 100 which, depending upon the form 
of connection, is capable of being used as a host 
computer and as a client computer. Fig. 2 illustrates 
an example in which five client computers 111 to 115 
have been connected to a fax/copier 2 00 via the computer 
100 serving as a host computer. The computers 100 and 
111 to 115 in Fig. 2 are capable of being implemented by 
identical architectures. The computer 100 serving as 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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the host computer may also be used as a fax server. In 
such case the host computer 100 would be capable of 
extracting data received by the fax/copier 200 and of 
distributing this data to the client computers 111 - 115 
in conformity with subaddresses . On the client side the 
clients would be able to search in the host computer and 
retrieve the data. 

Provided in the host computer 100 are a controller 
101, a volatile memory 102, such as a RAM, which is not 
backed up by a power supply, a non-volatile memory 103 
such as a ROM, hard-disk drive or floppy disk, an input 
device 105 such as a keyboard and mouse, a display 
device 106 such as a CRT display or liquid crystal 
display, and an external interface 107 . 

The controller 101, which includes interfaces for 
the CPU, input device 105 and display device 106, 
controls the overall computer 100. 

The external interface 107, such as a 
serial /parallel interface or network interface, is for 
effecting a connection to an external device or network. 
More specifically, the external interface 107 may having 
several interfaces of various types, such as an RS-232C, 
Centronics interface, USB, SCSI, IEEE-1394 interface, 
IrDA, etc. In this embodiment, an image input device 
150 such as a scanner is connected to the host computer 
100 via the external interface 107 in addition to the 
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fax/copier 200. 

The non-volatile memory 103 is internally provided 
with an area (basic-command-data area 104) for storing 
information concerning the control panel of a remotely 
controlled device, as will be described later. 

The fax/copier 200 can be just a facsimile machine 
or a copier having a facsimile function (a facsimile 
machine constructed around a printer or copier) . The 
fax/copier 200 is provided with a controller 201, a 
volatile memory 2 02, a non-volatile memory 2 03, a 
control panel 213, a printing device 208, an image 
reader 209, a communications unit 211 and an image 
processor 212. 

The controller 201 is connected to each of the 
components of the fax/copier 2 00 and exercises overall 
control such as operation of the fax/copier 200 and 
communication with an external device. The control 
panel 213 has an input device 205 and a display unit 
206. The display unit 206 is a liquid crystal panel 
provided on the control panel, and the input device 205 
comprises hardware- type keys and buttons likewise 
provided on the control panel or a touch-sensitive panel 
superimposed on the display unit. 

The printing device 208 is a printer such as a 
laser printer or ink- jet printer. The image reader 209 
is capable of employing a CCD or contact- type image 
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sensor. The communications unit 211 comprises, e.g., a 
modem and NCU and is for communicating with an external 
communications network. The image processor 212 
comprises a gate array for converting an analog image 
signal read by the image reader 209 to digital data and 
subjecting the data to binarization processing, error- 
diffusion processing and encoding. In addition, the 
image processor 212 decodes a code signal received by 
the communication unit 211. The image signal obtained 
by decoding is printed on a printing medium by the 
printing device 208. 

In a case where a laser printer is used as the 
printing device 208, the latter has a semiconductor 
laser and its controller, a polygon motor and its 
controller, an f-0 lens, an optical-path altering 
mirror, an OPC photosensitive drum and drum driving 
unit, toner, a toner stirring unit, toner supply unit 
and its controller, a photosensitive-drum charging unit 
and its controller, a toner transfer unit, a 
photosensitive-drum cleaning unit and its controller, an 
image fixing unit and its controller. As these 
components are of the ordinary type, however, they are 
not described here in detail. 

The volatile memory 2 02 and non-volatile memory 203 
in the fax/copier 200 can be constructed in a manner 
similar to the corresponding memories in the host 
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computer 100. The non-volatile memory 203 has an 
internally provided control-panel data area for storing 
control-panel data 2 04 which includes the appearance of 
the control panel 213 and commands that correspond to 
the input device 205. This data is capable of being 
transmitted to the host computer 100 via the controller 
201 and an external interface 207 or to a client 
computer on a network. The structure of the control- 
panel data 2 04 will now be described. 
<Data structure> 

Fig. 3 is a diagram showing an example of the 
structure of the control-panel data 204. This example 
of the data structure illustrates a case where the 
control panel has a display unit and is provided with 11 
buttons (keys) . Data 1 is machine model number serving 
as ID data for identifying the model, and data 2 is 
background data indicative of the background of the 
control panel . In order to more closely approximate the 
appearance of the control panel, data relating to the 
background of the control panel is used as necessary. 
The background data is composed of a series of 
coordinates the origin whereof is the lower left-hand 
corner. For example, the data includes coordinate data 
indicating the position of a background border, 
coordinates of a reference button (e.g., a start button) 
used to determine the layout of buttons, and appearance 
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data representing background color and design. 

Data 3 is display-means data. This comprises 
coordinate data indicating a position residing on the 
display unit, a flag indicating whether or not the 
display unit has a touch- sensitive panel function, 
appearance data representing color and design of the 
display unit, and screen data (for four screens in this 
example) used in a case where the screen displayed on 
the display unit is changed by a command (i.e., in a 
case where a different instruction screen is displayed 
when a prescribed position on the display unit is 
designated) . 

Data 4 to 14 is data relating to buttons (keys) 
possessed by the control panel. Each item of this data 
is composed of a flag indicating whether the type is 
button or touch-sensitive panel; a title representing a 
functional explanation, such as "SET" or "CLEAR", 
indicated above or below the button on the control 
panel; the command that is generated when the button is 
pressed; relative coordinates of this button with 
respect to the reference button; button size (e.g., 
length of the size of the smallest square that contains 
the button) ; and appearance data representing the button 
color and design. 

Said command can include setting or registration 
operation, as well as, operation data for fax/copier 
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200, as a computer macro. For example, the command 
consists of address setting operation to auto-dial 
button or speed dialing, copy condition setting 
(reduction/enlargement ratio, 2-sided copying, two-page 
5 separation, etc) and operational data (perform copying, 
etc.) of a fax/copier 200. This macro command can be 
assigned to a desired button. 

In a case where background data and display-means 
Q data is not used and appearance data relating to each 

■.r% 

Uj 10 button can be prepared on the side of the computer 100, 

ill the amount and types of data transmitted can be reduced. 

CJ Fig. 4 illustrates the structure of simplified control- 

. panel data and example of the data. 
^ In Fig. 4, column Dl contains the names of control- 

15 panel buttons, and column D2 contains button- type data 
which has one-to-one correspondence with the data m 
column Dl and is indicated by a two-digit hexadecimal 
number. Columns D3 and D4 indicate the relative 
positions of the buttons, and column D5 indicates the 
20 relative sizes of the buttons. In this embodiment, the 
relative position and relative size of the start button 
serve as references, and the relative positions and 
relative sizes of the other buttons are indicated by 
two-digit hexadecimal numbers. 
25 Transfer of this control-panel data can be 

implemented by any method. For example, in a case where 
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the control -panel data having the structure shown in 
Fig. 4 is transferred using a parallel interface capable 
of transferring 32 bits, a total of 32 bits representing 
the button-type data, relative positions X, Y and 
relative size are sent as one block after a header is 
transmitted, as illustrated in Fig. 5. After the blocks 
of all button- type data have been sent, a footer is 
appended and sent, thereby completing the transfer. 
Depending upon the width of the interface, blocks may be 
split and a checksum may be provided for each block. 
Further, the data may be sent by a serial interface. It 
is also possible to send the block singly in response to 
a transmission request from the computer side. 

Further, in a case where the computer 100 is 
capable of preparing all of the control -panel data 
necessary for each machine model from machines in 
addition to the fax/copier 200, as described later, it 
will suffice if the control-panel data 2 04 is merely 
data indicative of the model . 

< Reg i s t r a t i on opera t i on> 

Described next will be a registration operation 
performed by the computer 100 which remotely controls 
the fax/copier 200. The registration operation is one 
in which the computer 100 creates a virtual control 
panel of the remotely controllable apparatus and stores 
the virtual control panel in the non-volatile memory of 
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the computer 100. Once the virtual control panel has 
been stored in memory, processing for displaying the 
virtual control panel can be executed the next time by 
the computer 100 alone. This raises processing speed. 

Fig. 6 is a flowchart illustrating the registration 
operation performed by the computer 100. The first step 
is to make initial settings, such as initializing 
communication with the fax/copier 2 00 (S601) . Next, 
control -panel data that has been read out of the area 
204 in the non-volatile memory 203 of fax/copier 2 00 is 
loaded into the volatile memory 102 or erasable non- 
volatile memory 103 (S602). The loaded control-panel 
data is analyzed (S603) and, when necessary, a virtual 
control panel is created using data stored beforehand in 
the non-volatile memory (S604) . Correspondence is then 
established between position information concerning the 
virtual control panel and basic command data that has 
been stored in the basic-command-data area 104 of non- 
volatile memory 103 (S605) , and the correspondence data 
is stored in the volatile memory 102 or non-volatile 
memory 103 (S606) . 

In a case where a virtual control panel for each 
model and the correspondence data indicative of 
correspondence between the coordinates on the image and 
the basic commands for each model are present as a 
library in the external storage device or non-volatile 
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memory, etc., the data necessary at the time of the 
registration operation need be only information that can 
identify the control panel, such as the model name of 
the fax/copier 200, as mentioned above. Further, if it 
is possible for information that can identify the 
control panel to be entered directly from the input 
device of the computer 100, the registration operation 
can be concluded by the computer 100 alone. 

The library of control-panel data may be recorded 
collectively on so-called removable media such as a CD- 
ROM or magneto-optic disk or stored on an external 
storage device that is accessible from the computer 100. 
By way of example, the computer 100 searches the library 
on the basis of data such as the machine name entered 
from the input device and downloads the necessary data 
to a memory device of the computer 100. 

<Remote control> 

The operation of the computer 100 when it carries 
out remote control will now be described. In a case 
where a document that has been created by the computer 
100 is faxed by the fax/copier 2 00, the virtual control 
panel of the fax /copier registered in advance by the 
above -de scribed registration operation is displayed on 
the display device 106. Fig. 7 illustrates an example 
of a virtual control panel 300 displayed on the display 
device 106. Fig. 7 illustrates an example in which the 
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virtual control panel is displayed over the entire 
display area of the display device. However, an image 
of reduced size may be displayed near and edge portion, 
etc., of the display area. 
5 Remote control is carried out by operating the 

virtual control panel as if it were the control panel of 
the actual machine. More specifically, by using a 
pointing device such as a mouse or tablet as the input 
Q device 105, a pointer 3 01 is moved over a button and 

\j£ 10 clicked, or, in a case where a touch-sensitive panel is 

m 

i^i used as the input device, a position on the touch- 

sensitive panel corresponding to the button is pressed. 
In a case where a pointing device is not used, a desired 
key on the keyboard may be selected. 
15 The basic command that corresponds to the position 



i = !! 



information designated by the input device is 

transmitted to the fax/copier 200. For example, when a 
button representing a dial number 0 is clicked on the 
display device 106 (see Fig. 7) , the corresponding 

20 control-panel command data is sent to the fax/copier 

200, thereby issuing a command identical with that which 
would be obtained by pressing the "0" key on the control 
panel 213 of the fax/copier 200. 

If the transmission of commands is performed 

25 sequentially as opposed to transmission by pressing 

buttons one at a time, as described above, the commands 
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may be transmitted to the fax/copier 200 collectively- 
after all of the desired buttons have been pressed. 
Further, image processing at the time of a fax 
transmission may be executed in software fashion on the 
side of computer 100 or by the image processor 212 
within the fax/copier 200. 

Whether a command specified using the virtual 
control panel is reflected in the display area of the 
virtual control panel is optional. Though it would be 
desirable in terms of operability to reflect an 
operation performed on the virtual control panel in the 
display area of panel, this would increase the amount of 
control-panel data and increase the processing load 
relating to the virtual control panel. Accordingly, the 
choice should be made taking into consideration the 
processing capability of the computer 100. 

Further, it is not always necessary to imitate the 
appearance of the entire control panel of the actual 
machine. Only portions that are used frequently may be 
given an appearance close to that of the actual control 
panel, and display of buttons that are not used very 
often may be eliminated or may be replaced by images 
used commonly in all machine models. 

Furthermore, by so arranging it that the status of 
the fax/copier 200 is capable of being received at the 
time of remote control, the display of the virtual 



control panel can be altered based upon the status 
information received. For example, in a case where a 
warning lamp (tally lamp) provided on the control panel 
213 of the fax/copier lights, it is possible to change 
the display color of the tally lamp on the virtual 
control panel using the received status. More 
specifically, an arrangement may be adopted in which the 
fax/copier 200 notifies the computer 100 of its status 
periodically when it is operated by remote control, and 
in which the computer 100 interprets the received status 
information and controls the display of the virtual 
control panel accordingly. 

transmission of document from fax/copier> 
The operation of the computer 100 when a document 
is transmitted using the fax/copier 200 will be 
described with reference to Fig. 8. Fig. 8 is a 
flowchart illustrating the operation of the computer 100 
when a document to be transmitted has been placed on the 
fax/copier 200. 

The fax/copier 200 has an document sensor 210 (see 
Fig. 1) constituted by, e.g., a photointerrupter , that 
is capable of sensing insertion of the document to be 
transmitted. The arrangement is such that when 
insertion of the document is sensed, the document sensor 
210 sends the computer 100 a document- insertion signal 
indicative of the fact. 



The computer 100 monitors signals from the external 
interface 107 constantly. If the controller 101 senses 
the document-insertion signal ("YES" at S12), then the 
controller 101 causes the virtual control panel to be 
5 displayed on the display device 106 based upon the 

information in the non-volatile memory 103 (S13). In a 
case where the corresponding data has not been 
registered in the non-volatile memory 103, the 
Q registration operation described earlier is carried out 

hy 10 or use is made of data that has already been prepared in 

ij| an external storage device. 

w 

Cj Thus, remote control for setting reading 

~ conditions, indicating the start of reading and 

inputting the destination, etc., can be performed by the 
~* 15 computer 100 immediately merely by inserting the 

document into the fax/copier 200. By remotely 
controlling the fax/copier 200 from the computer 100, 
image data obtained by reading a document to be 
transmitted can be transmitted as an attachment to a 
20 word-processed document created in advance, thereby 
making unnecessary the conventional operation of 
importing the image to the word-processed document. 
<Fax transmission using image input device> 
The virtual control panel can be displayed 
25 automatically by similar processing when image data that 
has been entered using the input device 105 connected to 
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the host computer 100 is to be faxed using the 
fax/copier 200. 

Specifically, by adopting an arrangement in which 
when the input device 105 has sensed that a document is 
present on its platen or in its document feeder, the 
unit sends the computer 100 a signal indicating the 
presence of the document. This makes it possible to 
display the virtual control panel automatically in a 
manner similar to that when the fax/copier 200 is used. 
<Customizing the virtual control panel> 
The present invention is characterized in that the 
appearance of the virtual control panel is made to 
resemble the control panel of an actual machine. 
However, the invention also allows the layout of buttons 
or the like on the virtual control panel to be altered 
in accordance with user preference. An embodiment for a 
case where editing of the virtual control panel is 
performed will be described with reference to Figs. 9 
and 10. 

Fig. 9 is a flowchart illustrating editing of the 
virtual control panel performed by the computer 100, and 
Fig. 10 illustrates an example of an editing screen for 
editing the virtual control panel. 

When the virtual control panel is edited, first the 
position information contained in the control-panel data 
is ignored and the various control-panel elements are 



displayed in at-a-glance form (S901) . In this 
embodiment, the elements are displayed collectively on 
the right side of the screen of the display device 106 
(see numeral 400 in Fig. 10) . Displayed in the at-a- 
glance grouping 400 of elements are a display area 403, 
a start button 404 and an at-a-glance grouping of 
operating keys necessary for operating the fax/copier 
200. As described earlier, these control buttons have 
one-to-one correspondence with the items of basic 
command data 104 of the fax/copier 200. For example, in 
a case where the control button 404 which indicates the 
appearance of the start button is operated, a command is 
transmitted from the computer to the fax/copier so as to 
furnish an operating effect identical with that which 
would be obtained by operating the start button located 
on the control panel of the fax/copier. 

Next, the border of a virtual control panel 402 is 
displayed (S902). This indicates the limits of the 
virtual control panel after editing and allows the user 
to grasp positional relationships when buttons are laid 
out. Though the size of the border may be fixed or made 
variable, it is preferred that a limit be set if the 
border size is made variable. 

The editing of the virtual control panel 402 can be 
performed by using a pointing device such as a mouse as 
an input device, and dragging desired elements, which 



are displayed in the at-a-glance grouping 400 of 
elements, to desired positions within the border of the 
virtual control panel 402 using a pointer 401, thereby 
placing the desired elements at the desired positions. 
5 Fig. 10 shows the button 404 being dragged into the 

virtual control panel 402 so as to be placed there as a 
button 405. 

If an element such as a button is dragged from the 
at-a-glance grouping 400 of elements ("YES" at S903) and 
10 the destination of this movement is within the border of 
the virtual control panel 402 ("YES" at S904) , then the 
computer 100 pastes the dragged element within the 
border (S905) and stores the position information in the 
volatile memory temporarily (S909) . 
15 If the end of editing is specified by designating 

an edit end button (not shown) during editing ("YES" at 
step S906) , a designation is made as to whether priority 
should be given to use of the original virtual control 
panel or the virtual control panel that has been edited 
2 0 (S907) . This designating information as well as the 

control-panel element information that has been stored 
temporarily in the volatile memory is stored in a 
prescribed area of the non-volatile memory (S908) , after 
which editing processing is terminated. 
2 5 <Creation of virtual control panel on per-user 

basis, and utilization of virtual control panels> 
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In the example set forth above, only one virtual 
control panel can be edited per computer. However, in 
order to deal with occasions where one computer is 
shared by a plurality of individuals, it is possible to 
adopt an arrangement in which a different virtual 
control panel is constructed for each individual user. 

Fig. 11 illustrates an operation for generating a 
virtual control panel for each user. The editing of the 
virtual control panel may be the same as the operation 
shown in Fig. 9, and the steps S901 to S908 in Fig. 9 
are executed as an editing routine (S32). When editing 
ends, the user is prompted to enter a unique number such 
as a user ID (S3 5) . When entry of the user ID ends 
(S3 6) , correspondence with the edited control-panel data 
is established and the information is stored in the non- 
volatile memory (S37). 

These items of data may be stored in a storage 
device of the host computer 100 or in a storage device 
of the fax/copier 200. In the latter case, it will be 
possible for a user to use his or her own edited virtual 
control panel at any computer that is capable of 
remotely controlling the fax/copier 200. On the hand, 
since all of the data will be concentrated in the 
fax/copier 200 in this case, a problem relating to 
storage capacity arises. Accordingly, where the data 
should be stored is decided upon taking these factors 



into consideration . 

An operation in which the fax/copier 2 00 is 
remotely controlled using a virtual control panel that 
the user him/herself has edited will be described with 
reference to Fig. 12. Fig. 12 is a flowchart useful in 
describing a case where the user has inserted a document 
for transmission into the image input device 105 or into 
the document feeder of the fax/copier 200. When the 
presence of the document is sensed by the controller 101 
of the host computer 100 in response to the document- 
insertion signal ("YES" at S42), the computer 100 
compares a user ID, which has been entered at step S43 
requesting input of the user ID, with data that has been 
stored in the non-volatile memory, and determines 
whether the corresponding virtual control panel has been 
stored (S44) . If the corresponding data exists ("YES" 
at S45) , then the computer displays the virtual control 
panel that has been edited by the user (S46) . 
Thereafter, on the basis of commands entered from the 
displayed virtual control panel, the user sets the 
document reading conditions, indicates start of the 
document reading operation and commands processing of 
the read image, etc. 

If the corresponding data is not found, on the 
other hand, then the computer transmits the user ID and 
an inquiry command to the fax/copier 200 to inquire as 



to whether the corresponding data is present in the 
storage device of the fax/copier 200 (S47, S48) . If the 
corresponding data is found in the storage device of the 
fax/copier 200, the data is acquired (S49) and the user- 
edited virtual control panel is displayed (S46) . If the 
corresponding data is not found in the storage device of 
the fax/copier 200 either, then an inquiry as to whether 
the virtual control panel should be newly edited is sent 
to the user (S50) . If editing is desired, then an 
editing operation is performed in a manner similar to 
that shown in Fig. 11 (S51) , after which the user-edited 
virtual control panel is displayed (S46) . If editing 
anew is not desired, then a default virtual control 
panel possessed by the computer 100. is displayed (S52) . 

Adopting this arrangement makes it possible for 
each user to construct his or her own easy-to-use 
environment . 

In addition, managing address data, used for one 
button dial keys and/or speed dialing, etc., for each 
user ID, and if a virtual control panel of a certain 
user ID is retrieved, address data corresponding to the 
same user ID can be assigned to the buttons of the 
retrieved virtual control panel. 

Further, a batch of operations which the user 
frequently uses, e.g., a sequence of operations starting 
from setting a binding margin to 310mm, setting a 



document size to A4, enabling frame erase, setting two- 
page separation mode and setting a 2-side copy mode can 
be recorded as a macro and assigned to a certain button 
of a virtual control panel. Managing this user setting 
macro for each user ID allows setting of individual 
operation environment for each user. 
(Other Embodiments) 

In the foregoing embodiments, the present invention 
is described using an example in which a fax/copier is 
employed as the device remotely controlled by the user. 
However, if the device has a control panel and is 
capable of being remotely controlled by a user, then the 
present invention is applicable to such device. 

Further, one object of the present invention is 
realize a virtual control panel that is capable of being 
manipulated so that there is no disparity between a case 
where an actual machine is controlled by a user and a 
case where the machine is controlled by the user 
remotely from an information processing apparatus. It 
goes without saying that the scope of the present 
invention covers not only a virtual control panel having 
an appearance (positional relationship inclusive of 
background, size relationship and design) identical with 
that of the control panel of the actual machine but also 
a virtual control panel whose layout has been altered 
somewhat and an instance where only part of the control 



panel of the actual machine is displayed as the virtual 
control panel . 

Furthermore, it goes without saying that the object 
of the invention is attained by supplying a storage 
medium storing the program codes of the software for 
performing the functions of the foregoing embodiments to 
the computer 100, reading the program codes by the 
controller 101 (e.g., a CPU or MPU) from the storage 
medium, and then executing the program codes. 

In this case, the program codes read from the 
storage medium implement the novel functions of the 
invention, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy disk, 
hard disk, optical disk, magneto-optical disk, CD-ROM, 
CD-R, magnetic tape, non-volatile type memory card or 
ROM can be used to provide the program codes . 

Furthermore, besides the case where the aforesaid 
functions according to the embodiments are implemented 
by executing the program codes read by a computer, it 
goes without saying that the present invention covers a 
case where an operating system or the like running on 
the computer performs a part of or the entire process in 
accordance with the designation of program codes and 
implements the functions according to the embodiments. 

It goes without saying that the present invention 



further covers a case where, after the program codes 
read from the storage medium are written in a function 
expansion board inserted into the computer or in a 
memory provided in a function expansion unit connected 
5 to the computer, a CPU or the like contained in the 
function expansion board or function expansion unit 
performs a part of or the entire process in accordance 
with the designation of program codes and implements the 
function of the above embodiment. 
10 Thus, according to the invention, as described 

13 above, a remotely controllable apparatus which has a 

; S| control panel for specifying a processing operation and 

Ee which is operated in accordance with an indication from 

sjg the control panel and/or an externally supplied command, 

!~[ 15 or an information processing apparatus that is capable 

of remotely controlling this apparatus, is provided with 
storage means for storing control-panel data that 
represents the appearance of at least principal 
components of the control panel. This makes it possible 
20 to use a virtual control panel, the appearance of which 
resembles that of the actual control panel, created by 
utilizing the control-panel data. As a result, it is 
possible to utilize the virtual control panel without 
sensing any disparity between an instance where the 
25 remotely controllable apparatus is utilized by using the 
actual control panel and an instance where the apparatus 
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is controlled remotely from an external unit. This 
affords more user-friendly operation. Since a common 
control method is adopted, the probability of erroneous 
operation by the user can be reduced. 

Further, my making editing of the virtual control 
panel feasible, it is possible for each user to create a 
virtual control panel that is easy for the particular 
user to use. This makes it possible to realize a remote 
control system of greater convenience. 

Furthermore, in a case where the remotely 
controllable apparatus is an image processing apparatus 
having a reading device for reading a document, or a 
case where an image input device for reading a document 
and generating image information has been connected to 
an information processing system, the insertion of a 
document or the placing of the document on a platen is 
sensed and the information processing system is so 
notified, thereby making it possible to utilize the 
virtual control panel automatically merely by inserting 
or placing the document. This reduces labor demanded of 
the user. 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood that 
the invention is not limited to the specific embodiments 
thereof except as defined in the appended claims. 



